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1.  INTRODUCTION 


The  Navy  has  an  urgent  need  to  determine  microwave  propagation 
conditions  over  data-sparse  ocean  areas  for  both  real-time  and 
forecast  periods.  Any  radiosonde  measurements  available  to  Fleet 
units  are  usually  taken  only  from  carriers,  however,  and  then  on  a 
noninterfering  basis.  Thus  regular  assessment  and  forecasting  of 
anomalous  propagation  over  the  ocean  areas  must  rely  on  large  scale 
numerical  model  analysis  and  forecast  fields. 

The  procedure  discussed  In  this  report  --  developed  by 
Gjesslng  and  Moene  (1967)*  and  using  850  mb  data  --  has  been  shown 
to  be  effective  In  assessing  the  existence  of  anomalous  propagation 
In  certain  regions.  It  can  also  be  used  as  a  forecasting  aid  by 
application  to  forecast  fields  (prognoses). 

The  Gjesslng  and  Moene  procedure  Is  used  to  assess  and/or 
forecast  anomalous  propagation  from  the  surface  up  to  the  850  mb 
level;  this  anomalous  propagation  Is  then  classified  as  either 
ducting,  or  ductl ng-or-s uperrefracti on  .  The  vertical  location  of 
the  refractive  layer  In  the  surface-to-850  mb  region  can  not  be 
determined  by  applying  the  procedure. 

Gjesslng  and  Moene  used  radiosonde  data  to  calculate  the  850  mb 
parameter,  and  used  received-signal  data  to  determine  propagation 
conditions.  They  claimed  80%  accuracy  In  assessing  and  forecasting 
extended  radar  ranges  In  the  North  Sea  and  In  the  Mediterranean  Sea. 
This  present  report  reviews  and  analyzes  their  method  using 
radiosonde  data  gathered  off  the  west  coast  of  the  United  States. 


♦See  References . 


2.  WORK  OF  6JESSIN6  AND  MOENE 


The  Gjesslng  and  Noene  procedure  for  assessing  and  forecasting 
anomalous  propagation  (AP)  of  surface  radars  over  ocean  regions 
uses  signal  Intensity  data  as  a  basis  for  classifying  dally  propaga 
tlon  characteristics  as  being  either  normal  or  anomalous.  The 
Investigators  obtained  their  signal  data  by  positioning  a  receiver 
and  recorder  at  a  position  beyond  the  normal  radar/radio  horizon. 
The  normal  scattered  signal  Intensity  was  found  to  be  about  90  db 
below  1  mU.  The  threshold  signal  level  was  set  at  50  db,  and  any 
day  In  which  the  signal  strength  was  above  this  level  was  then 
classified  as  an  AP  day.  This  classification  of  days  by  signal 
strength  was  then  compared  to  a  determination  based  on  a  parameter 
which  Indicated  the  dryness  of  the  air  at  the  850  mb  level. 

The  assumption  In  the  use  of  this  parameter  was  that  If  dry 
air  resides  over  a  region  whose  surface  layer  Is  normally  moist  due 
to  a  vertical  water  vapor  flux  from  the  ocean  surface,  then  some¬ 
where  between  these  two  levels  a  steep  gradient  In  water  vapor 
probably  exists.  Such  gradients  would  vary  In  steepness,  providing 
for  superrefractlve  or  trapping  conditions.  The  850  mb  parameter 
was  defined  using  the  wet  term  of  the  refractlvlty,  N,  equation, 
as  follows: 

N  -  Nd  ♦  Nw 

Nd  -  77.6  P/T 

Nw  -  3.7xl05  e/T2 

aN  -  Nw(Ta)  -  Nw(Td) 

where 

e(T)  -  water  vapor  pressure  (mb); 

Ta  ■  air  temperature  (°K); 

Td  *  dew  point  temperature  (°K);  and 

P  ■  pressure  (mb) 

Gjesslng  and  Moene  found  the  critical  value  of  AN  to  be  15  N  -- 
If  aN  was  larger  than  15  N,  anomalous  propagation  was  assessed/ 
forecast . 


The  Investigators  recorded  data  for  443  days  using  L-band 
radars,  and  for  391  days  using  a  1  GHZ  radio  band.  These  data 
were  randomly  selected  from  the  three  years  of  data  for  each  link 
and  hence  are  each  an  Independent  sample.  Both  of  these  transmis¬ 
sion  data  links  were  over  water  In  the  North  Sea  region.  The 
results  of  the  analysis  from  these  two  links  are  given  In  the 
contingency  tables  la  and  1b. 


Table  la.  L-Band  radar. 


I 

Observed  Signal 

Total s 

AP 

Normal 

AP  ( A N > 1 5N) 
Calculated 

118 

16 

134 

Normal  (aN<15N) 

24 

285 

309 

Total s 

142 

301 

443 

Table  lb.  1  GHZ  radio  band. 


Observed  Signal 

Totals 

AP 

Normal 

AP  ( A N > 1 5N) 

Cal  cul  ated 

33 

7 

40 

KHBUffiBHM 

6 

34  5 

351 

Totals 

39 

352 

391 

As  given  In  Tables  la  and  lb,  the  total  number  of  days 
correctly  calculated  Is  the  sum  of  the  diagonal  elements;  the 
percentages  correct  are  91  %  and  97%  respectively.  Of  the  number 
of  AP  days  assessed  for  the  1  GHZ  band,  82%  were  correct 
(pre fl gurance*) ,  and  85%  of  the  number  of  the  observed  AP  days  were 
correctly  forecast  (post  a greement** ) .  Both  of  these  percentages 


•Percentage  of  correct  forecasts  of  the  event. 
••Percentage  of  observations  forecasted  correctly. 
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are  related  to  operational  use  of  such  a  procedure  since  they  judge 
Its  false  alarm  rate  and  accuracy,  respectively. 

The  skill  of  a  forecast  procedure  also  can  be  judged  by 
comparing  its  results  to  the  skill  of  climatology  or  to  chance. 

The  Heidke  skill  score  (Heldke,  1926)  Is  one  such  method  that  has 
been  used  by  the  National  Weather  Service  to  compare  forecast 
capabilities  from  year  to  year  (Pierce,  1976).  The  Heldke  skill 
scores  for  climatology  for  the  L-band  radar  and  1  GHZ  radio  band 
are  .789  and  .817,  respectively,  while  the  skill  scores  for  normal 
precipitation  forecasts  range  from  .500  to  .600  (Pierce,  1976). 
Compared  to  these  percentages,  the  skill  of  the  Gjessing  and  Moene 
procedure  in  the  North  Sea  region  is  evident;  other  questions 
remain,  however,  and  these  are  addressed  in  this  present  study. 
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3.  STUDY  PROCEDURES 


This  study  Mas  conducted  to  determine  the  skill  of  the  AN 
procedure  In  some  region  other  than  the  North  Sea,  to  determine 
Independently  the  critical  value  of  AN  and  to  determine  the 
vertical  region  of  greatest  skill.  Because  transmission  data  such 
as  those  used  by  Gjesslng  and  Moene  are  difficult  to  obtain  In 
large  quantities,  radiosonde  data  Mere  used  for  this  study.  The 
soundings  Mere  analyzed  for  type  of  refractive  structure  In  the 
defined  region  of  assessment.  The  same  soundings  Mere  used  to 
calculate  the  value  of  AN  at  the  850  mb  level. 

The  calculated  value  of  AN  Mas  compared  to  a  selected  critical 


val  ue  of  AN,  AN, 


•-  If  AN>ANr, 

m  v 


anomalous  propagation  Mas  assessed. 


A  contingency  table  Mas  generated  and  a  Heidke  skill  score  was 
calculated;  the  data  analysis  was  then  iterated  on  the  critical  AN( 
by  Increments  of  2N,  beginning  at  8N.  The  value  of  ANc  which 
provided  the  maximum  skill  score  was  taken  as  the  optimum  aN£. 
Figure  1  depicts  the  assessment  region  relative  to  the  AN 
determi nation  1 evel . 

Several  vertical  regions  of  assessment  were  analyzed  to 
determine  If  one  particular  region  provided  significantly 
better  skill.  The  layer  adjacent  to  the  surface,  for  example, 
was  examined  for  the  skill  of  the  procedure  and  also  for  the 
effects  of  the  region  on  the  skill  of  larger  regions.  Figure  2 
shows  the  seven  regions  of  assessment,  where  refractive  conditions 
were  classified  as  normal  ducting  (D)  or  ducting  and/or  super¬ 
refraction  ( DSR ) .  The  relationships  of  these  three  refractive 
conditions,  interms  of  N  gradients,  are  diagrammed  by  below. 


ducti  ng 


ductl ng/ super re  fraction 

I  - -I 

I  I  — 

- |  I 

I  I 


normal- 


■1  57 


-100 


£riLC.Lui.'G  ri-.vS.  bJu^OC-WOT  f  X 
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Figure  1.  Region  of  assessment  relative  to  level  of  AH  calculation. 
The  analysis  procedure  iterates  on  a  selected  initial  AHC.  The 
assessment  based  on  the  value  of  AH  is  related  to  the  anomalous 
propagation  in  the  region  of  assessment  for  all  1525  soundings 
using  2x2  contingency  tables. 


REGIONS  OF  ASSESSMENT 


Figure  2.  The  seven  regions  of  assessment.  The  primary  region,  850  mb 
to  surface,  is  divided  into  several  sub-regions,  two  of  which  are  of 
constant  thickness.  The  constant-pressure  difference  regions  evaluate 
the  procedure's  skill  in  such  partial  regions. 


The  radiosonde  data  used  in  this  study  were  obtained  by  radar 
picket  ships  stationed  off  the  U.S.  west  coast  during  the  period 
1959-65.  More  than  6900  soundings  were  archived  by  the  National 
Climatic  Center;  radiosondes  were  launched  from  ships  stationed 
between  29°N  and  51°N,  approximately  200-300  n  mi  off  the  coast. 

The  data  were  separated  into  five  latitude  zones  numbered 
1-5,  with  demarcation  latitudes  at  29°N,  34°N,  38°N,  41°N,  46°N 
and  51°N  (see  Figure  3).  Data  from  zone  2,  1500  soundings,  were 
used  in  this  study. 


LATITUDE 

Cr73  $  2522  1382  s 


Figure  3.  Geographical  distribution  of  radiosonde  data,  1959-65. 
Data  from  Zone  2  were  used  in  the  present  study. 
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4.  RESULTS 


4.1  OPTIMUM  CRITICAL  AN 

The  optimum  value  of  AN  Is  defined  as  the  value  which  corres¬ 
ponds  to  the  highest  skill  score.  To  be  sure  that  a  true  maximum 
existed  for  purposes  of  this  study,  the  iterative  procedure  was 
continued  well  beyond  the  first  maximum.  In  each  case  the  apparent 
maximum  was  the  true  maximum.  Figure  4's  two  plots  show  S  versus 
AN  curves  for  the  two  types  of  AP  for  the  850  mb  surface  region. 

The  maximum  ducting-only  occurs  in  a  relatively  flat  part  of  the 

curve  and  may  indeed  be  hiding  a  multitude  of  local  maximums. 

The  existence  of  a  maximum  may  seem  curious  at  first;  the 
accuracy  of  assessing  AP  would  seemingly  improve  with  increasing 
aN  (an  increasingly  more  restrictive  discriminant).  The  reason 
for  the  decrease  in  skill  score  after  a  maximum  can  be  seen  from 
the  listings  in  Table  2,  which  shows  tabulations  for  the  DSR  type 
of  AP  in  the  850-950  mb  region. 

850mb  to-siirface  region 

_ AP  tfucting/superref  faction  1DSR) 

0$R - AP  ducting  (D) 

Optimum 


AN 


Figure  4.  Plot  of  4NC  versus  skill  score  showing  that  optimum  values 
of  4NC  exist  for  ducting/superrefraction  AP  (solid  line)  and  ducting 
AP  (dashed  line). 
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Table  2,  Occurrence  of  OSR  AP  In  the  850-950  mb  reglo 


H 

SKILL 

Score 

CORRECT 

ASSESSMENT  (%) 

PERCENT 

Total  Correct 

AP 

KfflSSH 

10 

.568 

72 

97 

79 

12 

.631 

75 

97 

82 

14 

.672 

78 

95 

84 

16 

.703 

81 

93 

85 

18 

.729 

83 

93 

86 

20 

.730 

84 

91 

87 

22 

.727 

85 

89 

86 

24 

.720 

85 

87 

86 

26 

.71  3 

87 

84 

86 

28 

.694 

87 

87 

85 

30 

.682 

88 

80 

84 
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The  accuracy  of  AP  assessment  steadily  increases  with 
increasing  aNc  ,  as  suspected.  Normal  assessment  accuracy  steadily 
decreases  with  increasing  aNc  .  The  reason  for  this  decreasing 
accuracy  is  that  more  cases  of  AP  are  occurring  when  aN<aN  , 

v* 

because  of  the  higher  value  of  aN£.  As  aN£  exceeds  the  optimum 
value,  the  increase  in  AP  assessment  slows,  and  the  loss  in 
accuracy  of  normal  propagation  assessment  overrides  the  improving 
AP  assessment.  The  skill  score  then  begins  to  decrease,  since  the 
score  considers  both  correct  and  Incorrect  normal  and  AP  assessments. 

4.2  PREFIGURANCE  AND  POST  AGREEMENT 

Prefigurance  and  post  agreement  percentages  indicate  false 
alarm  rates  and  accuracy,  res pect i vel y ,  and  are  defined  as  (1)  the 
percentage  of  forecasts  of  the  event  that  are  correct,  and  (2)  the 
percentage  of  observations  correctly  forecasted. 

The  prefigurance  and  post-agreement  percentages  were  calculated 
for  all  seven  regions  of  assessment  and  for  each  of  the  AP  types. 

The  AP  prefigurance  percentages  for  the  AN  procedure  are  larger 

V 

for  ducting  and/or  superrefraction  than  for  ducting  alone.  The 
prefigurance  percentages  are  less  for  the  partial  regions  than  for 
the  850  mb- to-s urface  region,  which  indicates  a  lower  false-alarm 
rate  for  the  850  mb-to-surface  region  than  for  the  partial  regions. 
The  post  agreement  percentages  are  uniformly  high,  even  for  those 
regions  having  low  prefigurance  percentages.  The  tendency,  then, 
is  for  the  AN  procedure  to  o ver- forecas t  the  AP  event,  particularly 

V 

in  the  lower-skill  regions.  These  results  are  given  in  Table  3. 

The  assessment  of  normal  propagation  conditions  have  higher 
prefigurance  values  than  those  of  AP  conditions.  The  normal 
prefigurance  percentages  are  higher  for  the  ducting  type  AP  than 
for  the  ducting  and/or  superrefraction  type  AP.  The  false-alarm 
rate  therefore  is  lower  for  normal  conditions  than  the  rate  for  AP 
conditions.  Table  4  shows  the  normal  prefigurance  and  post¬ 
agreement  percentages. 


13 


Table  3.  Summary  of  percentages  of  correct  assessments 
(pref Igurance)  and  correctly  assessed  observations  (post  agreement) 
for  anomalous  propagation,  showing  higher  percentages  for  ducting/ 
superrefraction  than  for  ducting. 


Assessment 

Region 

AP  Type* 

AP 

Pre  f 1 gurance 
Percentage 

AP  Post 

Agreement 

Percentage 

Top 

Bottom 

850  mb 

Surface 

DSR 

D 

90 

67 

85 

75 

850  mb 

9  SO  mb 

DSR 

D 

84 

57 

92 

83 

850  mb 

900  mb 

DSR 

D 

53 

24 

93 

87 

900  mb 

Surface 

DSR 

D 

67 

46 

70 

74 

900  mb 

950  mb 

DSR 

0 

54 

36 

85 

87 

1000  m 

Surface 

DSR 

D 

58 

43 

67 

66 

300  m 

Surface 

DSR 

D 

21 

6 

80 

71 

*D  -  Ducting 

DSR  -  Ducting  and/or  superrefraction 
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Table  4.  Summary  of  percentages  of  correct  assessments 
(preflgurance)  and  correctly  assessed  normal  propagation  observa¬ 
tions  (post  agreement),  showing  higher  percentages  for  ducting 
than  for  ductlng/superrefractlon. 


Asses 

ReS 

sment 

Ion 

AP  Type* 

Normal 

Pref 1 gurance 
Percentage 

Normal 

Post  Agreement 
Percentage 

Top 

Bottom 

850  mb 

Surface 

0SR 

D 

76 

86 

84 

79 

850  mb 

9  50  mb 

DSR 

D 

91 

92 

80 

76 

850  mb 

900  mb 

DSR 

D 

95 

97 

57 

58 

900  mb 

Surface 

DSR 

D 

75 

90 

73 

71 

900  mb 

9  50  mb 

DSR 

0 

93 

97 

71 

69 

1000  m 

Surface 

OSR 

D 

— 

77 

89 

69 

75 

300  m 


Surface 


DSR 

0 


86 

95 


29 

35 


4.3  SKILL  SCORES  AND  OPTIMUM  aN„ 

c 

The  skill  scores  for  the  ducti ng/superref ractlon  (DSR)  type 
of  AP  are  highest  when  the  upper  limit  of  the  assessment  region 
is  the  850  mb  level.  The  two  highest  skill  scores  are 

Region  Skill  Score  (S) 

850  to  surface  .67 

850  to  950  .73 

The  Increase  in  S  for  the  region  excluding  950  mb  to  the 
surface  is  undoubtedly  due  to  the  removal  of  the  area  of  inaccu¬ 
rate  radiosonde  data  due  to  ship  effects*,  and  to  the  lack  of 
skill  of  the  procedure  in  the  lowest  region.  The  region  of  300  mb 
to  the  surface  shows  no  skill  over  climatology.  The  intermediate 
regions,  as  tabulated  below,  have  almost  identical  skill  scores, 
indicating  no  particular  region  in  which  the  procedure  performs 
best . 

Region  Skill  Score  (S) 


850 

to 

900 

.43 

900 

to 

950 

.48 

900 

to 

s  u  r  f  a  c  e 

.42 

Figure  5  depicts  skill  scores  and  optimum  aNc  for  both  DSR  and 
ducti ng  AP . 

The  skill  scores  of  the  procedure  for  ducting  are  lower  than 
those  for  DSR.  The  tabulation  below  shows  the  partial  regions 
(the  last  three)  having  low  scores,  with  no  region  preferred. 


Reqion 

Skill  Score 

850  to  surface 

.53 

850  to  950 

.52 

850  to  900 

.22 

900  to  950 

.36 

900  to  surface 

U> 

OP 

•Biases  in  temperature  and  relative  humidity  in  near-surface  data 
of  radiosondes  can  cause  Inaccurate  profiles  of  these  parameters. 
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DUCTING/SUPERREFRACTION 

AMc- - ►SKILL 


Figure  5.  Combined  summary  for  both  classes  of  anomalous  propagation, 
ductlng/superrefractlon  and  ducting,  showing  the  larger  optimum  ANC 
values  for  ducting  AP.  4NC  and  skill  scores  for  both  types  of  AP 
are  shown  for  each  of  the  seven  assessment  regions. 


The  first  two  regions,  which  show  the  best  skill,  encompass 
essentially  the  same  region  as  that  examined  by  Gjesslng  and  Moene. 
The  tabulated  skill  scores  are  considerably  below  the  scores 
reported  by  Gjessing  and  Moene  (.79  and  .82)  because  the  former 
are  for  ducting,  which  Is  a  more  restrictive  type  of  anomalous 
propagation  . 


The  values  of  optimum  ANC  for  assessment  of  ducting  are  much 
larger  than  those  for  assessment  of  DSR .  This  seems  reasonable 
since  ducting  requires  steeper  water  vapor  gradients  than  does 
superrefraction .  Steeper  water  vapor  gradients  would  require  drier 
air  aloft,  thereby  making  larger  aN£  values  necessary  to  provide 
the  greatest  skill  scores.  Figure  5  shows  that  aNc  values  for 
ducting  are  1  1/4  to  2  times  larger  than  aNc  values  for  DSR. 

4.4  COMPARING  aN  PROCEDURE  TO  SIMPLE  CLIMATOLOGY 

A  simple  climatological  procedure  can  be  defined  as  one  in 
which  anomalous  propagation  Is  always  assessed  if  the  climatological 
probability  Is  greater  than  0.5,  and  normal  propagation  Is  always 
assessed  If  the  climatological  probability  Is  less  than  0.5. 

Table  5,  which  compares  the  AN  procedure  with  simple  climatology. 
Indicates  that  In  all  cases  the  AN  procedure  yields  better  assess¬ 
ments  than  does  simple  climatology  In  ocean  areas. 
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Table  5.  Comparison  of  forecasts  by  the  aNc  procedure  with  fore¬ 
casts  by  simple  climatology  for  AP  and  normal  conditions.* 


AP 

NORMAL 

Percent  of 

Forecast 

Correct 

Percent  of 

Occurrences 

Forecasted 

Percent  of 

Forecasts 

Correct 

Percent  of 

Occurrences 

Forecasted 

AN>_36 

Ducting  Surf. 
Cut-off 

C 1 i mo  .  =  .37 

an 

Climo 

aN 

Climo 

AN 

Climo 

AN 

Climo 

67 

0 

75 

0 

86 

63 

79 

63 

AN  >31 

Ducting  &  SR 
Surf.  Cut-off 
Climo.  3  .67 

90 

67 

85 

■ 

76 

0 

84 

0 

AN  >_3  6 

Ducting  950  mb 
cut-off 

Climo.  =  .28 

57 

0 

83 

0 

92 

72 

76 

72 

Ducting  *  SR 

950  mb  cut-off 
Climo  3  .54 
aN>20 

84 

54 

92 

54 

41 

0 

80 

_ 

0 

Climatological  probability  >0.5:  AP  assessed. 

Climatological  probability  <0.5:  normal  propagation  assessed 


5.  SUMMARY 


The  assessment  of  AP  by  the  AN  procedure  achieves  its  highest 
Heidke  skill  for  combined  ducting  and  superrefraction  from  the 
surface  to  the  850  mb  level.  The  procedure  has  very  little  skill 
over  chance  or  climatology  for  the  surface- to-300  mb  region.  The 
assessment  seems  to  be  conservative;  that  is,  the  procedure  tends 
to  overforecast  AP  and  thus  produce  a  high  false-alarm  rate.  The 
assessment  of  normal  propagation  conditions  has  a  much  lower  false- 
alarm  rate. 

The  value  of  aNc  used  for  discriminating  between  AP  and  normal 
conditions  is  the  value  which  maximizes  the  skill  score.  It  was 
found  that  a  unique  maximum  existed  for  each  of  the  assessment/ 
forecast  regions.  This  optimum  value  of  ANc  varied  from  18  for 
ducting  and  superrefraction  (DSR)  to  36  to  40  for  ducting  only  (D), 
depending  on  the  region  of  assessment/forecast.  The  skill  scores 
Increased  for  both  the  850  mb  and  900  mb  top-cut-off  for  DSR  when 
the  bottom  cut-off  was  set  at  950  mb,  rather  than  the  surface. 

The  opposite  was  true  for  the  case  of  ducting  only. 

This  procedure  has  no  prediction/assessroent  capability  for 
altitude  of  the  AP  structure;  there  are  indications,  however,  that 
Improved  skill  scores  result  when  the  bottom  of  the  assessment 
region  is  elevated  off  the  surface. 


6.  FUTURE  INVESTIGATIONS 

The  AN  procedure  will  be  examined  using  the  other  four  zones 
of  the  available  picket  ship  data.  Independent  data  sets  will  be 
used  to  determine  the  stability  of  the  critical  AN  value. 
Variations  In  skill  and  critical  AN  for  each  of  the  five  zones 
will  be  examined.  The  procedure  will  be  converted  from  the 
categorical  (yes-no)  assessment  to  probability  assessment.  Use  of 
the  procedure  will  be  evaluated  In  other  ocean  areas  where  radio¬ 
sonde  data  are  available. 
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